Pandas Profiling Report

Dataset statistics

Number of variables	34
Number of observations	250306
Missing cells	1280168
Missing cells (%)	15.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	64.9 MiB
Average record size in memory	272.0 B

Variable types

CAT	18
NUM	9
DATE	3
UNSUPPORTED	2
BOOL	2

Reproduction

Analysis started	2020-05-12 05:25:54.933794
Analysis finished	2020-05-12 05:26:47.321055
Duration	52.39 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`clean_up_cost` has constant value "0.0"	Constant
`inspector_name` has a high cardinality: 173 distinct values	High cardinality
`violator_name` has a high cardinality: 119992 distinct values	High cardinality
`violation_street_name` has a high cardinality: 1791 distinct values	High cardinality
`mailing_address_str_name` has a high cardinality: 37896 distinct values	High cardinality
`city` has a high cardinality: 5184 distinct values	High cardinality
`state` has a high cardinality: 59 distinct values	High cardinality
`violation_code` has a high cardinality: 235 distinct values	High cardinality
`violation_description` has a high cardinality: 258 distinct values	High cardinality
`state_fee` is highly correlated with `admin_fee`	High correlation
`admin_fee` is highly correlated with `state_fee`	High correlation
`judgment_amount` is highly correlated with `late_fee` and 1 other fields	High correlation
`late_fee` is highly correlated with `judgment_amount` and 1 other fields	High correlation
`balance_due` is highly correlated with `late_fee` and 1 other fields	High correlation
`admin_fee` is highly correlated with `disposition` and 2 other fields	High correlation
`disposition` is highly correlated with `admin_fee` and 1 other fields	High correlation
`state_fee` is highly correlated with `disposition` and 2 other fields	High correlation
`compliance_detail` is highly correlated with `admin_fee` and 1 other fields	High correlation
`violation_zip_code` has 250306 (100.0%) missing values	Missing
`mailing_address_str_number` has 3602 (1.4%) missing values	Missing
`non_us_str_code` has 250303 (> 99.9%) missing values	Missing
`hearing_date` has 12491 (5.0%) missing values	Missing
`payment_date` has 209193 (83.6%) missing values	Missing
`collection_status` has 213409 (85.3%) missing values	Missing
`grafitti_status` has 250305 (> 99.9%) missing values	Missing
`compliance` has 90426 (36.1%) missing values	Missing
`violation_street_number` is highly skewed (γ1 = 377.3438821)	Skewed
`mailing_address_str_number` is highly skewed (γ1 = 37.93517109)	Skewed
`discount_amount` is highly skewed (γ1 = 76.0604994)	Skewed
`ticket_id` has unique values	Unique
`violation_zip_code` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`zip_code` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`late_fee` has 105884 (42.3%) zeros	Zeros
`discount_amount` has 249126 (99.5%) zeros	Zeros
`judgment_amount` has 90621 (36.2%) zeros	Zeros
`payment_amount` has 209193 (83.6%) zeros	Zeros
`balance_due` has 111510 (44.5%) zeros	Zeros

ticket_id
Real number (ℝ_≥0)

UNIQUE

Distinct count	250306
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	152665.5430992465
Minimum	18645
Maximum	366178
Zeros	0
Zeros (%)	0.0%
Memory size	1.9 MiB

Quantile statistics

Minimum	18645
5-th percentile	31442.25
Q1	86549.25
median	152597.5
Q3	219888.75
95-th percentile	272190.75
Maximum	366178
Range	347533
Interquartile range (IQR)	133339.5

Descriptive statistics

Standard deviation	77189.88288
Coefficient of variation (CV)	0.5056143077
Kurtosis	-1.198430396
Mean	152665.5431
Median Absolute Deviation (MAD)	66662.5
Skewness	-0.01400732945
Sum	3.821310143e+10
Variance	5958278019

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
22517	1	< 0.1%
31066	1	< 0.1%
26968	1	< 0.1%
53583	1	< 0.1%
55630	1	< 0.1%
49485	1	< 0.1%
51532	1	< 0.1%
61771	1	< 0.1%
63818	1	< 0.1%
59720	1	< 0.1%
Other values (250296)	250296	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
18645	1	< 0.1%
18646	1	< 0.1%
18648	1	< 0.1%
18649	1	< 0.1%
18650	1	< 0.1%

Value	Count	Frequency (%)
366178	1	< 0.1%
366176	1	< 0.1%
325562	1	< 0.1%
325561	1	< 0.1%
325560	1	< 0.1%

agency_name
Categorical

Distinct count	5
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

Buildings, Safety Engineering & Env Department	157784
Department of Public Works	74717
Health Department	8903
Detroit Police Department	8900
Neighborhood City Halls	2

Common Values
Length

Value	Count	Frequency (%)
Buildings, Safety Engineering & Env Department	157784	63.0%
Department of Public Works	74717	29.9%
Health Department	8903	3.6%
Detroit Police Department	8900	3.6%
Neighborhood City Halls	2	< 0.1%

Length

Max length	46
Median length	46
Mean length	38.25159205
Min length	17

inspector_name
Categorical

HIGH CARDINALITY

Distinct count	173
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

Morris, John	17926
Steele, Jonathan	13237
Samaan, Neil J	12733
O'Neal, Claude	11591
Devaney, John	10769
Other values (168)	184050

Common Values
Length

Value	Count	Frequency (%)
Morris, John	17926	7.2%
Steele, Jonathan	13237	5.3%
Samaan, Neil J	12733	5.1%
O'Neal, Claude	11591	4.6%
Devaney, John	10769	4.3%
Sims, Martinzie	9976	4.0%
Sloane, Bennie J	9730	3.9%
Hayes, Billy J	9493	3.8%
Doetsch, James	7108	2.8%
Zizi, Josue	6587	2.6%
Other values (163)	141156	56.4%

Length

Max length	26
Median length	14
Mean length	14.45237429
Min length	10

violator_name
Categorical

HIGH CARDINALITY

Distinct count	119992
Unique (%)	47.9%
Missing	34
Missing (%)	< 0.1%
Memory size	1.9 MiB

INVESTMENT, ACORN	809
INVESTMENT CO., ACORN	425
BANK, WELLS FARGO	328
MILLER, JOHN	205
SHIFMAN, ALLEN	192
Other values (119987)	248313

Common Values
Length

Value	Count	Frequency (%)
INVESTMENT, ACORN	809	0.3%
INVESTMENT CO., ACORN	425	0.2%
BANK, WELLS FARGO	328	0.1%
MILLER, JOHN	205	0.1%
SHIFMAN, ALLEN	192	0.1%
NEW YORK, BANK OF	184	0.1%
COMMISSION, DETROIT HOUSING	178	0.1%
STEHLIK, JERRY	162	0.1%
SNOW, GEORGE	147	0.1%
APARTMENTS, CARLTON	139	0.1%
Other values (119982)	247503	98.9%

Length

Max length	79
Median length	16
Mean length	17.35222887
Min length	3

violation_street_number
Real number (ℝ_≥0)

SKEWED

Distinct count	19175
Unique (%)	7.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	10649.858437272778
Minimum	0.0
Maximum	14154108.0
Zeros	195
Zeros (%)	0.1%
Memory size	1.9 MiB

Quantile statistics

Minimum	0
5-th percentile	806
Q1	4739
median	10244
Q3	15760
95-th percentile	19960
Maximum	14154108
Range	14154108
Interquartile range (IQR)	11021

Descriptive statistics

Standard deviation	31887.33142
Coefficient of variation (CV)	2.994155425
Kurtosis	160011.9662
Mean	10649.85844
Median Absolute Deviation (MAD)	5513
Skewness	377.3438821
Sum	2665723466
Variance	1016801905

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1509	240	0.1%
0	195	0.1%
600	182	0.1%
19300	153	0.1%
1401	132	0.1%
15700	123	< 0.1%
8200	115	< 0.1%
20200	112	< 0.1%
9125	109	< 0.1%
14300	107	< 0.1%
Other values (19165)	248838	99.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	195	0.1%
1	28	< 0.1%
2	62	< 0.1%
3	2	< 0.1%
4	4	< 0.1%

Value	Count	Frequency (%)
14154108	1	< 0.1%
6114175	1	< 0.1%
1116292	2	< 0.1%
1111111	2	< 0.1%
438444	1	< 0.1%

violation_street_name
Categorical

HIGH CARDINALITY

Distinct count	1791
Unique (%)	0.7%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

SEVEN MILE	3482
MCNICHOLS	3041
LIVERNOIS	2482
GRAND RIVER	1766
EVERGREEN	1749
Other values (1786)	237786

Common Values
Length

Value	Count	Frequency (%)
SEVEN MILE	3482	1.4%
MCNICHOLS	3041	1.2%
LIVERNOIS	2482	1.0%
GRAND RIVER	1766	0.7%
EVERGREEN	1749	0.7%
FENKELL	1512	0.6%
ASBURY PARK	1491	0.6%
WARREN	1443	0.6%
ARCHDALE	1373	0.5%
EIGHT MILE	1367	0.5%
Other values (1781)	230600	92.1%

Length

Max length	18
Median length	8
Mean length	7.730589758
Min length	3

violation_zip_code
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	250306
Missing (%)	100.0%
Memory size	1.9 MiB

mailing_address_str_number
Real number (ℝ_≥0)

MISSING
SKEWED

Distinct count	15826
Unique (%)	6.4%
Missing	3602
Missing (%)	1.4%
Infinite	0
Infinite (%)	0.0%

Mean	9149.787802386665
Minimum	1.0
Maximum	5111345.0
Zeros	0
Zeros (%)	0.0%
Memory size	1.9 MiB

Quantile statistics

Minimum	1
5-th percentile	36
Q1	544
median	2456
Q3	12927.25
95-th percentile	26656
Maximum	5111345
Range	5111344
Interquartile range (IQR)	12383.25

Descriptive statistics

Standard deviation	36020.3424
Coefficient of variation (CV)	3.93674074
Kurtosis	3053.83814
Mean	9149.787802
Median Absolute Deviation (MAD)	2314
Skewness	37.93517109
Sum	2257289250
Variance	1297465067

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
213	1934	0.8%
1	1662	0.7%
4	1181	0.5%
3	979	0.4%
11	677	0.3%
3476	567	0.2%
5	530	0.2%
131	528	0.2%
21	513	0.2%
36	471	0.2%
Other values (15816)	237662	94.9%
(Missing)	3602	1.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1662	0.7%
2	464	0.2%
3	979	0.4%
4	1181	0.5%
5	530	0.2%

Value	Count	Frequency (%)
5111345	1	< 0.1%
3511219	1	< 0.1%
3216632	1	< 0.1%
2515238	2	< 0.1%
2511455	3	< 0.1%

mailing_address_str_name
Categorical

HIGH CARDINALITY

Distinct count	37896
Unique (%)	15.1%
Missing	4
Missing (%)	< 0.1%
Memory size	1.9 MiB

PO BOX	8668
P.O. BOX	7182
GRAND RIVER	1249
LIVERNOIS	1205
W. MCNICHOLS	990
Other values (37891)	231008

Common Values
Length

Value	Count	Frequency (%)
PO BOX	8668	3.5%
P.O. BOX	7182	2.9%
GRAND RIVER	1249	0.5%
LIVERNOIS	1205	0.5%
W. MCNICHOLS	990	0.4%
GREENFIELD	762	0.3%
GRATIOT	757	0.3%
E. JEFFERSON	751	0.3%
HARPER	713	0.3%
P.O. Box	707	0.3%
Other values (37886)	227318	90.8%

Length

Max length	30
Median length	8
Mean length	9.181346032
Min length	1

city
Categorical

HIGH CARDINALITY

Distinct count	5184
Unique (%)	2.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

DETROIT	136936
SOUTHFIELD	13436
Detroit	10496
detroit	4183
DEARBORN	3637
Other values (5179)	81618

Common Values
Length

Value	Count	Frequency (%)
DETROIT	136936	54.7%
SOUTHFIELD	13436	5.4%
Detroit	10496	4.2%
detroit	4183	1.7%
DEARBORN	3637	1.5%
FARMINGTON HILLS	2329	0.9%
OAK PARK	2216	0.9%
WARREN	2000	0.8%
DET	1657	0.7%
W. BLOOMFIELD	1635	0.7%
Other values (5174)	71781	28.7%

Length

Max length	39
Median length	7
Mean length	7.982649237
Min length	1

state
Categorical

HIGH CARDINALITY

Distinct count	59
Unique (%)	< 0.1%
Missing	93
Missing (%)	< 0.1%
Memory size	1.9 MiB

MI	228601
CA	5020
TX	2420
FL	2237
IL	1310
Other values (54)	10625

Common Values
Length

Value	Count	Frequency (%)
MI	228601	91.3%
CA	5020	2.0%
TX	2420	1.0%
FL	2237	0.9%
IL	1310	0.5%
SC	1304	0.5%
OH	967	0.4%
NY	673	0.3%
MN	632	0.3%
GA	535	0.2%
Other values (49)	6514	2.6%

Length

Max length	3
Median length	2
Mean length	2.000371545
Min length	2

zip_code
Unsupported

REJECTED
UNSUPPORTED

Missing	1
Missing (%)	< 0.1%
Memory size	1.9 MiB

non_us_str_code
Categorical

MISSING

Distinct count	2
Unique (%)	66.7%
Missing	250303
Missing (%)	> 99.9%
Memory size	1.9 MiB

ONTARIO, Canada	2
, Australia	1

Common Values
Length

Value	Count	Frequency (%)
ONTARIO, Canada	2	< 0.1%
, Australia	1	< 0.1%
(Missing)	250303	> 99.9%

Length

Max length	15
Median length	3
Mean length	3.000127844
Min length	3

country
Categorical

Distinct count	5
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

USA	250293
Cana	7
Aust	3
Egyp	2
Germ	1

Common Values
Length

Value	Count	Frequency (%)
USA	250293	> 99.9%
Cana	7	< 0.1%
Aust	3	< 0.1%
Egyp	2	< 0.1%
Germ	1	< 0.1%

Length

Max length	4
Median length	3
Mean length	3.000051936
Min length	3

ticket_issued_date
Date

Distinct count	86979
Unique (%)	34.7%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

Minimum	1938-10-09 15:30:00
Maximum	2011-12-31 16:15:00

Histogram

Histogram

hearing_date
Date

MISSING

Distinct count	6222
Unique (%)	2.6%
Missing	12491
Missing (%)	5.0%
Memory size	1.9 MiB

Minimum	2005-01-27 09:00:00
Maximum	2017-01-27 10:30:00

Histogram

Histogram

violation_code
Categorical

HIGH CARDINALITY

Distinct count	235
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

9-1-36(a)	99091
9-1-81(a)	43471
22-2-88	28720
9-1-104	22536
22-2-88(b)	7238
Other values (230)	49250

Common Values
Length

Value	Count	Frequency (%)
9-1-36(a)	99091	39.6%
9-1-81(a)	43471	17.4%
22-2-88	28720	11.5%
9-1-104	22536	9.0%
22-2-88(b)	7238	2.9%
22-2-45	5394	2.2%
9-1-43(a) - (Dwellin	5332	2.1%
9-1-105	5072	2.0%
9-1-110(a)	4814	1.9%
22-2-22	3755	1.5%
Other values (225)	24883	9.9%

Length

Max length	20
Median length	9
Mean length	8.841989405
Min length	6

violation_description
Categorical

HIGH CARDINALITY

Distinct count	258
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

Failure of owner to obtain certificate of compliance	99091
Failure to obtain certificate of registration for rental property	43471
Failure of owner to keep property, its sidewalks, or adjoining public property free from solid waste	28719
Excessive weeds or plant growth one- or two-family dwelling or commercial Building	22536
Allowing bulk solid waste to lie or accumulate on or about the premises	7238
Other values (253)	49251

Common Values
Length

Value	Count	Frequency (%)
Failure of owner to obtain certificate of compliance	99091	39.6%
Failure to obtain certificate of registration for rental property	43471	17.4%
Failure of owner to keep property, its sidewalks, or adjoining public property free from solid waste	28719	11.5%
Excessive weeds or plant growth one- or two-family dwelling or commercial Building	22536	9.0%
Allowing bulk solid waste to lie or accumulate on or about the premises	7238	2.9%
Violation of time limit for approved containers to remain at curbside - early or late	5394	2.2%
Rodent harborage one-or two-family dwelling or commercial building	5072	2.0%
Inoperable motor vehicle(s) one- or two-family dwelling or commercial building	4814	1.9%
Bulk solid waste deposited more than 24 hours before designated time	3944	1.6%
Failure of owner of one- or two-family dwelling to comply with an emergency or imminent danger order concerining an unsafe or unsanitar	3613	1.4%
Other values (248)	26414	10.6%

Length

Max length	241
Median length	65
Mean length	69.82484639
Min length	20

disposition
Categorical

HIGH CORRELATION

Distinct count	9
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

Responsible by Default	138340
Not responsible by Dismissal	48695
Not responsible by City Dismissal	34401
Responsible by Admission	13701
Responsible by Determination	7644
Other values (4)	7525

Common Values
Length

Value	Count	Frequency (%)
Responsible by Default	138340	55.3%
Not responsible by Dismissal	48695	19.5%
Not responsible by City Dismissal	34401	13.7%
Responsible by Admission	13701	5.5%
Responsible by Determination	7644	3.1%
Not responsible by Determination	6639	2.7%
PENDING JUDGMENT	387	0.2%
SET-ASIDE (PENDING JUDGMENT)	304	0.1%
Responsible (Fine Waived) by Deter	195	0.1%

Length

Max length	34
Median length	22
Mean length	25.24434492
Min length	16

fine_amount
Real number (ℝ_≥0)

Distinct count	43
Unique (%)	< 0.1%
Missing	1
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	374.42343540880125
Minimum	0.0
Maximum	10000.0
Zeros	195
Zeros (%)	0.1%
Memory size	1.9 MiB

Quantile statistics

Minimum	0
5-th percentile	50
Q1	200
median	250
Q3	250
95-th percentile	1000
Maximum	10000
Range	10000
Interquartile range (IQR)	50

Descriptive statistics

Standard deviation	707.1958066
Coefficient of variation (CV)	1.888759462
Kurtosis	58.96312069
Mean	374.4234354
Median Absolute Deviation (MAD)	0
Skewness	6.42730943
Sum	93720058
Variance	500125.9089

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
250	141245	56.4%
50	28378	11.3%
100	21435	8.6%
200	18683	7.5%
500	11244	4.5%
1000	7934	3.2%
300	6649	2.7%
3500	6269	2.5%
2500	2619	1.0%
25	2275	0.9%
Other values (33)	3574	1.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	195	0.1%
1	1	< 0.1%
20	2	< 0.1%
25	2275	0.9%
50	28378	11.3%

Value	Count	Frequency (%)
10000	357	0.1%
8000	1	< 0.1%
7000	13	< 0.1%
5000	285	0.1%
3500	6269	2.5%

admin_fee
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

20	159880
0	90426

Common Values
Length

Value	Count	Frequency (%)
20	159880	63.9%
0	90426	36.1%

Length

Max length	4
Median length	4
Mean length	3.638738184
Min length	3

state_fee
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

10	159880
0	90426

Common Values
Length

Value	Count	Frequency (%)
10	159880	63.9%
0	90426	36.1%

Length

Max length	4
Median length	4
Mean length	3.638738184
Min length	3

late_fee
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct count	37
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	21.494505924748108
Minimum	0.0
Maximum	1000.0
Zeros	105884
Zeros (%)	42.3%
Memory size	1.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	10
Q3	25
95-th percentile	50
Maximum	1000
Range	1000
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	56.46426326
Coefficient of variation (CV)	2.626916081
Kurtosis	89.31129566
Mean	21.49450592
Median Absolute Deviation (MAD)	10
Skewness	7.785447985
Sum	5380203.8
Variance	3188.213025

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	105884	42.3%
25	79621	31.8%
5	17655	7.1%
10	12516	5.0%
20	11354	4.5%
50	6545	2.6%
100	4803	1.9%
350	3785	1.5%
30	3680	1.5%
250	1506	0.6%
Other values (27)	2957	1.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	105884	42.3%
0.1	1	< 0.1%
2.5	1223	0.5%
5	17655	7.1%
9.5	2	< 0.1%

Value	Count	Frequency (%)
1000	195	0.1%
800	1	< 0.1%
700	13	< 0.1%
500	85	< 0.1%
350	3785	1.5%

discount_amount
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct count	13
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.12516679584188953
Minimum	0.0
Maximum	350.0
Zeros	249126
Zeros (%)	99.5%
Memory size	1.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	350
Range	350
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	3.430177755
Coefficient of variation (CV)	27.40485392
Kurtosis	7220.032173
Mean	0.1251667958
Median Absolute Deviation (MAD)	0
Skewness	76.0604994
Sum	31330
Variance	11.76611943

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	249126	99.5%
25	605	0.2%
5	167	0.1%
10	155	0.1%
20	135	0.1%
50	43	< 0.1%
3	19	< 0.1%
30	17	< 0.1%
100	16	< 0.1%
350	15	< 0.1%
Other values (3)	8	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	249126	99.5%
3	19	< 0.1%
5	167	0.1%
10	155	0.1%
13	1	< 0.1%

Value	Count	Frequency (%)
350	15	< 0.1%
250	6	< 0.1%
100	16	< 0.1%
50	43	< 0.1%
40	1	< 0.1%

clean_up_cost
Boolean

CONSTANT
REJECTED

Distinct count	1
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

0	250306

Frequency Table

Value	Count	Frequency (%)
0	250306	100.0%

judgment_amount
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct count	57
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	268.6853563238596
Minimum	0.0
Maximum	11030.0
Zeros	90621
Zeros (%)	36.2%
Memory size	1.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	140
Q3	305
95-th percentile	580
Maximum	11030
Range	11030
Interquartile range (IQR)	305

Descriptive statistics

Standard deviation	626.9152124
Coefficient of variation (CV)	2.333268999
Kurtosis	86.07829501
Mean	268.6853563
Median Absolute Deviation (MAD)	140
Skewness	7.605726876
Sum	67253556.8
Variance	393022.6835

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	90621	36.2%
305	79621	31.8%
85	17655	7.1%
140	12516	5.0%
250	11355	4.5%
280	7177	2.9%
580	6545	2.6%
1130	4803	1.9%
3880	3785	1.5%
360	3680	1.5%
Other values (47)	12548	5.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	90621	36.2%
31.1	1	< 0.1%
50	1	< 0.1%
55	155	0.1%
57.5	1223	0.5%

Value	Count	Frequency (%)
11030	195	0.1%
8830	1	< 0.1%
7730	13	< 0.1%
5530	85	< 0.1%
3880	3785	1.5%

payment_amount
Real number (ℝ_≥0)

ZEROS

Distinct count	533
Unique (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	48.898986440596715
Minimum	0.0
Maximum	11075.0
Zeros	209193
Zeros (%)	83.6%
Memory size	1.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	280
Maximum	11075
Range	11075
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	222.422425
Coefficient of variation (CV)	4.548610128
Kurtosis	390.3978971
Mean	48.89898644
Median Absolute Deviation (MAD)	0
Skewness	15.50633584
Sum	12239709.7
Variance	49471.73513

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	209193	83.6%
305	7797	3.1%
280	6415	2.6%
255	4535	1.8%
85	2728	1.1%
140	2176	0.9%
130	2056	0.8%
250	1699	0.7%
80	1635	0.7%
120	1585	0.6%
Other values (523)	10487	4.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	209193	83.6%
0.5	1	< 0.1%
3	4	< 0.1%
5	10	< 0.1%
7	1	< 0.1%

Value	Count	Frequency (%)
11075	1	< 0.1%
11030	6	< 0.1%
10030	3	< 0.1%
7760	1	< 0.1%
7410	1	< 0.1%

balance_due
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct count	606
Unique (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	222.44905795306545
Minimum	-7750.0
Maximum	11030.0
Zeros	111510
Zeros (%)	44.5%
Memory size	1.9 MiB

Quantile statistics

Minimum	-7750
5-th percentile	0
Q1	0
median	25
Q3	305
95-th percentile	580
Maximum	11030
Range	18780
Interquartile range (IQR)	305

Descriptive statistics

Standard deviation	606.3940102
Coefficient of variation (CV)	2.725990462
Kurtosis	96.10064154
Mean	222.449058
Median Absolute Deviation (MAD)	25
Skewness	8.008018813
Sum	55680333.9
Variance	367713.6956

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	111510	44.5%
305	67281	26.9%
85	14092	5.6%
140	9324	3.7%
250	8967	3.6%
25	7692	3.1%
580	5673	2.3%
1130	4151	1.7%
360	3402	1.4%
3880	3386	1.4%
Other values (596)	14828	5.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-7750	1	< 0.1%
-4820	1	< 0.1%
-3880	1	< 0.1%
-3795	1	< 0.1%
-3580	1	< 0.1%

Value	Count	Frequency (%)
11030	187	0.1%
10530	1	< 0.1%
8830	1	< 0.1%
7730	13	< 0.1%
5530	78	< 0.1%

payment_date
Date

MISSING

Distinct count	2307
Unique (%)	5.6%
Missing	209193
Missing (%)	83.6%
Memory size	1.9 MiB

Minimum	2005-01-25 00:00:00
Maximum	2017-01-25 00:00:00

Histogram

Histogram

payment_status
Categorical

Distinct count	3
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

NO PAYMENT APPLIED	209193
PAID IN FULL	31931
PARTIAL PAYMENT APPLIED	9182

Common Values
Length

Value	Count	Frequency (%)
NO PAYMENT APPLIED	209193	83.6%
PAID IN FULL	31931	12.8%
PARTIAL PAYMENT APPLIED	9182	3.7%

Length

Max length	23
Median length	18
Mean length	17.41800836
Min length	12

collection_status
Categorical

MISSING

Distinct count	1
Unique (%)	< 0.1%
Missing	213409
Missing (%)	85.3%
Memory size	1.9 MiB

IN COLLECTION	36897

Common Values
Length

Value	Count	Frequency (%)
IN COLLECTION	36897	14.7%
(Missing)	213409	85.3%

Length

Max length	13
Median length	3
Mean length	4.474075731
Min length	3

grafitti_status
Categorical

MISSING

Distinct count	1
Unique (%)	100.0%
Missing	250305
Missing (%)	> 99.9%
Memory size	1.9 MiB

GRAFFITI TICKET	1

Common Values
Length

Value	Count	Frequency (%)
GRAFFITI TICKET	1	< 0.1%
(Missing)	250305	> 99.9%

Length

Max length	15
Median length	3
Mean length	3.000047941
Min length	3

compliance_detail
Categorical

HIGH CORRELATION

Distinct count	10
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

non-compliant by no payment	129267
not responsible by disposition	89735
non-compliant by late payment more than 1 month	19016
compliant by late payment within 1 month	6300
compliant by on-time payment	3880
Other values (5)	2108

Common Values
Length

Value	Count	Frequency (%)
non-compliant by no payment	129267	51.6%
not responsible by disposition	89735	35.9%
non-compliant by late payment more than 1 month	19016	7.6%
compliant by late payment within 1 month	6300	2.5%
compliant by on-time payment	3880	1.6%
compliant by early payment	992	0.4%
not responsible by pending judgment disposition	691	0.3%
compliant by no fine	195	0.1%
compliant by payment with no scheduled hearing	161	0.1%
compliant by payment on unknown date	69	< 0.1%

Length

Max length	47
Median length	27
Mean length	29.9981223
Min length	20

compliance
Boolean

MISSING

Distinct count	2
Unique (%)	< 0.1%
Missing	90426
Missing (%)	36.1%
Memory size	1.9 MiB

0	148283
1	11597
(Missing)	90426

Frequency Table

Value	Count	Frequency (%)
0	148283	59.2%
1	11597	4.6%
(Missing)	90426	36.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	ticket_id	agency_name	inspector_name	violator_name	violation_street_number	violation_street_name	violation_zip_code	mailing_address_str_number	mailing_address_str_name	city	state	zip_code	non_us_str_code	country	ticket_issued_date	hearing_date	violation_code	violation_description	disposition	fine_amount	admin_fee	state_fee	late_fee	judgment_amount	payment_amount	balance_due	payment_date	payment_status	collection_status	grafitti_status	compliance_detail	compliance
0	22056	Buildings, Safety Engineering & Env Department	Sims, Martinzie	INVESTMENT INC., MIDWEST MORTGAGE	2900.0	TYLER	NaN	3.0	S. WICKER	CHICAGO	IL	60606	NaN	USA	2004-03-16 11:40:00	2005-03-21 10:30:00	9-1-36(a)	Failure of owner to obtain certificate of compliance	Responsible by Default	250.0	20.0	10.0	25.0	305.0	0.0	305.0	NaT	NO PAYMENT APPLIED	NaN	NaN	non-compliant by no payment	0.0
1	27586	Buildings, Safety Engineering & Env Department	Williams, Darrin	Michigan, Covenant House	4311.0	CENTRAL	NaN	2959.0	Martin Luther King	Detroit	MI	48208	NaN	USA	2004-04-23 12:30:00	2005-05-06 13:30:00	61-63.0600	Failed To Secure Permit For Lawful Use Of Building	Responsible by Determination	750.0	20.0	10.0	75.0	855.0	780.0	75.0	2005-06-02	PAID IN FULL	NaN	NaN	compliant by late payment within 1 month	1.0
2	22062	Buildings, Safety Engineering & Env Department	Sims, Martinzie	SANDERS, DERRON	1449.0	LONGFELLOW	NaN	23658.0	P.O. BOX	DETROIT	MI	48223	NaN	USA	2004-04-26 13:40:00	2005-03-29 10:30:00	9-1-36(a)	Failure of owner to obtain certificate of compliance	Not responsible by Dismissal	250.0	0.0	0.0	0.0	0.0	0.0	0.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
3	22084	Buildings, Safety Engineering & Env Department	Sims, Martinzie	MOROSI, MIKE	1441.0	LONGFELLOW	NaN	5.0	ST. CLAIR	DETROIT	MI	48214	NaN	USA	2004-04-26 13:30:00	NaT	9-1-36(a)	Failure of owner to obtain certificate of compliance	Not responsible by City Dismissal	250.0	0.0	0.0	0.0	0.0	0.0	0.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
4	22093	Buildings, Safety Engineering & Env Department	Sims, Martinzie	NATHANIEL, NEAL	2449.0	CHURCHILL	NaN	7449.0	CHURCHILL	DETROIT	MI	48206	NaN	USA	2004-04-26 13:00:00	2005-03-29 10:30:00	9-1-36(a)	Failure of owner to obtain certificate of compliance	Not responsible by Dismissal	250.0	0.0	0.0	0.0	0.0	0.0	0.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
5	22046	Buildings, Safety Engineering & Env Department	Sims, Martinzie	KASIMU, UKWELI	6478.0	NORTHFIELD	NaN	2755.0	E. 17TH	LOG BEACH	CA	908041512	NaN	USA	2004-05-01 11:50:00	2005-03-21 10:30:00	9-1-36(a)	Failure of owner to obtain certificate of compliance	Responsible by Default	250.0	20.0	10.0	25.0	305.0	0.0	305.0	NaT	NO PAYMENT APPLIED	NaN	NaN	non-compliant by no payment	0.0
6	18738	Buildings, Safety Engineering & Env Department	Williams, Darrin	Deerwood Development Group Inc, Deer	8027.0	BRENTWOOD	NaN	476.0	Garfield	Clinton	MI	48038	NaN	USA	2004-06-14 14:15:00	2005-02-22 15:00:00	61-63.0500	Failed To Secure Permit For Lawful Use Of Land	Responsible by Default	750.0	20.0	10.0	75.0	855.0	0.0	855.0	NaT	NO PAYMENT APPLIED	NaN	NaN	non-compliant by no payment	0.0
7	18735	Buildings, Safety Engineering & Env Department	Williams, Darrin	Rafee Auto Services L.L.C., RAF	8228.0	MT ELLIOTT	NaN	8228.0	Mt. Elliott	Detroit	MI	48211	NaN	USA	2004-06-16 12:30:00	2005-02-22 15:00:00	61-63.0100	Noncompliance/Grant Condition/BZA/BSE	Responsible by Default	100.0	20.0	10.0	10.0	140.0	0.0	140.0	NaT	NO PAYMENT APPLIED	NaN	NaN	non-compliant by no payment	0.0
8	18733	Buildings, Safety Engineering & Env Department	Williams, Darrin	Rafee Auto Services L.L.C., RAF	8228.0	MT ELLIOTT	NaN	8228.0	Mt. Elliott	Detroit	MI	48211	NaN	USA	2004-06-16 12:25:00	2005-02-22 15:00:00	61-63.0100	Noncompliance/Grant Condition/BZA/BSE	Responsible by Default	100.0	20.0	10.0	10.0	140.0	0.0	140.0	NaT	NO PAYMENT APPLIED	NaN	NaN	non-compliant by no payment	0.0
9	28204	Buildings, Safety Engineering & Env Department	Williams, Darrin	Inc, Nanno	15307.0	SEVEN MILE	NaN	1537.0	E. Seven Mile	Detroit	MI	48205	NaN	USA	2004-07-12 13:30:00	2005-05-31 13:30:00	61-63.0600	Failed To Secure Permit For Lawful Use Of Building	Responsible by Default	750.0	20.0	10.0	75.0	855.0	0.0	855.0	NaT	NO PAYMENT APPLIED	NaN	NaN	non-compliant by no payment	0.0

Last rows

	ticket_id	agency_name	inspector_name	violator_name	violation_street_number	violation_street_name	violation_zip_code	mailing_address_str_number	mailing_address_str_name	city	state	zip_code	non_us_str_code	country	ticket_issued_date	hearing_date	violation_code	violation_description	disposition	fine_amount	payment_date	payment_status	collection_status	grafitti_status	compliance_detail	compliance
250296	366178	Buildings, Safety Engineering & Env Department	Bush, Wesley	MARK JACKSON	8020.0	PURITAN	NaN	251.0	HEYDEN	DETROT	MI	48219	NaN	USA	2006-07-28 14:00:00	2016-10-06 09:00:00	9-1-111	Failure of owner to remove graffiti or maintain or restore property free of graffiti.	Not responsible by City Dismissal	100.0	NaT	NO PAYMENT APPLIED	NaN	GRAFFITI TICKET	not responsible by disposition	NaN
250297	366176	Buildings, Safety Engineering & Env Department	Bush, Wesley	MARK JACKSON	8020.0	PURITAN	NaN	251.0	HEYDEN	DETROT	MI	48219	NaN	USA	2006-07-28 14:00:00	2016-10-06 09:00:00	9-1-36(a)	Failure of owner to obtain certificate of compliance	Not responsible by City Dismissal	250.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250298	325560	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250299	325556	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250300	325558	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250301	325555	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	SANTA MARIA	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250302	325557	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250303	325562	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250304	325559	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN
250305	325561	Buildings, Safety Engineering & Env Department	Bush, Wesley	WESTGATE TERRACE APARTMENTS LLC	10701.0	MEYERS RD	NaN	1715.0	MEYERS	DETROIT	MI	48235	NaN	USA	2010-12-02 11:00:00	2015-01-06 09:00:00	9-1-43(a) - (Structu	Fail to comply with an Emergency or imminent danger order concerining an unsafe or unsanitary structure or unlawful occupancy (all other structures, except buildings with five (5) or more stories)	Not responsible by City Dismissal	1000.0	NaT	NO PAYMENT APPLIED	NaN	NaN	not responsible by disposition	NaN

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows